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Abstract 

A subthreshold signal is transmitted through a channel and may 
be detected when some noise - with known structure and proportional 
to some level - is added to the data. There is an optimal noise level, 
called stochastic resonance, that corresponds to the highest Fisher 
information in the problem of estimation of the signal. As noise we 
consider an ergodic diffusion process and the asymptotic is considered 
as time goes to infinity. 

We propose consistent estimators of the subthreshold signal and 
we solve further a problem of hypotheses testing. We also discuss 
evidence of stochastic resonance for both estimation and hypotheses 
testing problems via examples. 

keywords: stochastic resonance, diffusion processes, unobservable 
signal detection, maximum a posterior probability. 
MSG: 93E10, 62M99. 

1 Introduction 

The term 'stochastic resonance' was introduced in the early '80s (see and 



17 1) in the study of periodic advance of glaciers on Earth. The stochastic 
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resonance is the effect of nonmonotone dependence of the response of a system 
on the noise when this noise (for instance the temperature) is added to a 
periodic input signal (see e.g. in which the author explains also differences 
and similarities with the notion of stochastic filtering). An extensive review 
on stochastic resonance and its presence in different fields of applications 
can be found in [|^. Following 0, as stochastic resonance we intend the 
phenomenon in which the transmission of a signal can be improved (in terms 
of statistical quantities) by the addition of noise. From the statistical point 
of view the problem is to estimate a signal {f(t), t < T} transmitted through 
a channel. This signal has to be detected by a receiver that can reveal signals 
louder than a threshold r. If /(■) is bounded from above by r, the signal 
is not observable and the problem has not a solution. But, if some noise 
{e{t), t < T} is added to the signal, the perturbed signal y(t) = f{t) + e{t) 
may be observable and inference can be done on /(■). Too few noise is not 
sufficient to give good estimates and too much noise deteriorates excessively 
the signal. The optimal - in some sense - level of the noise will be called 
stochastic resonance in this framework. Usually (see ||^) the criterion applied 
to measure optimality of estimators are the Shannon mutual information or 
the KuUback divergence. More recently the Fisher information quantity have 
been also proposed (see and 0). Here we are concerned with the Fisher 
information quantity. It happens that this quantity, as a function of the 
noise, can be maximized for certain noise structures. If there is only one 
global maximum, the corresponding noise level is the value for which we have 
stochastic resonance, if several local maxima are present, the phenomenon is 
called stochastic multi-resonance. 

In this paper we study the problem of estimation and hypotheses testing 
for the following model: we suppose to have a threshold r > and a sub- 
threshold constant and non negative signal 6, 6 < t. We add, in continuous 
time, a noise that is a trajectory of a diffusion process {Xt, t < T} and we 
observe the perturbed signal {Yt = 6 + eXt, t < T} where e > is the level 
of the noise. We propose two schemes of observations: i) we observe only 
the proportion of time spent by the perturbed signal over the threshold r 
and a) we measure the energy of the perturbed signal when it is above the 
threshold. The asymptotic is considered as time goes to infinity. 

This approach differs from the ones in the current statistical literature ba- 
sically for two reasons: the noise structure is an ergodic diffusion process and 
not a sequence of independent and identically distributed random variables 
and data are collected in continuous time. This second aspect is a substantial 
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difference but it is not a problem from the point of view of applications for 
the two schemes of observations proposed if one thinks at analogical devices. 

We propose two different estimators for the schemes and we study their 
asymptotic properties. We present an example where, in both cases, it 
emerges the phenomenon of stochastic resonance. For the same model we 
also solve the problem of testing the simple hypothesis 9 = 9q against the 
simple alternative 6* = by applying the bayesian maximum a posterior 
probability criterion. It emerges that the overall probability of error is non- 
monotonically dependent on e. We show again that there exists a non trivial 
local minimum of this probability that is again the effect of stochastic reso- 
nance. The presence of stochastic resonance in this context is noted for the 
first time here. 

The paper is organized as follows. In Section ^ we set up the regularity 
assumptions of the model. In sections ^ and ^ we prove some asymptotic 
properties estimators for the two schemes and we calculate numerically the 
points where the Fisher information quantity attains its maximum for both 
models. It turns out that the estimators proposed are asymptotically equiv- 
alent to the maximum likelihood estimators. Section ^ is devoted to the 
problem of hypotheses testing. All the figures are collected at the end of the 
paper. 



2 The model and the structure of the noise 

Let T be the threshold and 9 a constant signal. Taking < 9 < t will not 
influence the calculations that follows but may improve the exposition, so we 
use this assumption. Let {Xt^t < T} be a given diffusion process solution to 
the following stochastic differential equation 

dX, = S{Xt)dt + a{Xt)dWt (1) 

with non random initial value Xq = 0. The process {Xt,t < T} is supposed 
to have the ergodic property with invariant measure P* and invariant dis- 
tribution function F{x) = P*((— oo,a;]) as T — > oo. The functions S{-) and 
cr(-) satisfy the global Lipschitz condition 

\Six) - Siy)\ + - aiy)\ < L\x - y|, (CI) 

where L is the Lipschitz constant. Under condition |U1| , equation (|1|) has a 
unique strong solution (see e.g. |T^) but any equivalent condition to can 
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be assumed because we do not use explicitly it in the sequel. The following 
conditions are needed to ensure the ergodicity of the process {Xt,t <T}. If 

y 

lim [ = -oo (C2) 







and 



G = jaiyr'exphJ^duldyK^ (C3) 

M I J 

then there exists the stationary distribution function F{-) and it takes the 
following form 

F{x) = I aiy)-'exp | 2 J ^d« I dy . 

-oo K ) 

Again, any other couple of conditions that imply the existence of F{-) can 
be used instead of |C3] and [C^ . 

We perturb the signal 9 by adding, proportionally to some level e > 0, 
the trajectory diffusion process {Xt,t < T} into the channel. The result 
will be the perturbed signal {Yt = 9 + eXt,t < T}. This new signal will be 
detectable only when it is above the threshold r. Moreover, {Yt, t < T} is still 
ergodic with trend and diffusion coefficients respectively Sei^y) = S{{y — 9)/e) 
and ad{{y — 9)/e) and initial value Yq = 9, but we will not use directly this 
process. We denote by {M^ = YtX{Yt>T},t < T} the observable part of the 
trajectory of {Yt,t < T}, being xa the indicator function of the set A. 

We consider two possibile schemes of observation: 

i) we observe only the proportion of time spent by {Yt,t < T} over the 
threshold r 

T 

1 



Tt = ^ y X{Yt>r}dt , 


ii) we measure the energy of the signal {Mt, t < T} 

T 



1 

T 



Tyr^ = - I M^dt . 
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In the next sections, for the two models we establish asymptotic properties 



of estimators given by the generalized method of moments. In |TT| different 
properties of the generalized method of moments for ergodic diffusion pro- 
cesses are studied. In this note we follows the lines given in the paper of for 
the i.i.d. setting. These results are interesting in themselves independently 
from the problem of stochastic resonance. We give an example of stochastic 
resonance based on the Ornstein-Uhlenbeck process where the phenomenon 
of stochastic resonance appears pronounced and in which results in a closed 
form can be written down. 

3 Observing the time spent by the process 
over the threshold 

The random variable Tt can be rewritten in terms of the process {Xt, t < T} 
as 



By the ergodic property of {Xt,t < T} we have that 

where ^ has F{-) as distribution function. From (0) it derives that 

e = e{7i) = T + eP-^l - tt) , 
so that ^ is a one-to-one continuous function of tt. From the Glivenko-Cantelli 



theorem (see e.g. |Tl|) for the empirical distribution function (EDF) defined 
by 

/X 
X{Xt<x}dt 
-oo 

follows directly that Tt is a -\/T-consistent estimator of tt thus also 

Ot = e{TT) = T + eF-\l - Tt) , 



is a vT-consistent estimator for 9. We can calculate the asymptotic variance 
of this estimator. It is known that (see and |T^) the EDF is asymptotically 
Gaussian and in particular 

Vt (^Fr(x) - F(x)) =^ U (0, V{x)) , 
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where V{x) = If{x) ^ is the inverse of the analogue of the Fisher information 
quantity in the problem of distribution function estimation : 



-1 



where a Ab = min(a, 6) and a\/ b = max(a, 6). The quantity V{x) is also 
the minimax asymptotic lower bound for the quadratic risk associated to the 
estimation of F{x), so that Ft{x) is asymptotically efficient in this sense. 

The asymptotic variance S(^) of Ox can be derived by means of the so- 
called (5-method (see e.g. [|l|): 



^{e (Ft) -e(7r)) = Vf{TT-n)e'{TT)+OT{\TT-Tr\) 

thus 



S(e) = e 



where /(■) is the density of F{-). The quantity can also be derived from 
the asymptotic minimal variance V^(-) of the EDF estimator. In fact, with 
little abuse of notation, by putting F{x) = ^ and 6{^) = t — eF~^{^) we 
have that 

3.1 Link with the UkeUhood estimator 

We now show that F^ also maximizes the approximate likelihood of the 
model. In fact, for the central limit theorem for the EDF we have 



Ft{x) = F{x) + ^^Z + ot{1) 
where Z is a standard Gaussian random variable. Thus 
P (Ft < 7) = P f 1 - Ft ( ) < 7 
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where $() is the distribution function of Z . We approximate the hkehhood 
function of by 



[ T(l-rr-F(^))' 



that is maximal when 

thus, the maximum hkehhood estimator of Q (constructed on the approxi- 
mated hkehhood) reads 

eT = T- eP-^ (1 - Tt) . 

So if the approximation above is acceptable, one can infer the optimality 
property of Tt of having minimum variance from being also the maximum 
likelihood estimator. 

3.2 An example of stochastic resonance 

To view the effect of stochastic resonance on the Fisher information we con- 
sider a particular example. By setting S{x) = —x and cr(x) = 1 the noise 
become a standard Ornstein-Uhlenbeck process solution to the stochastic 
differential equation 

dXt = -Xtdt + dWt . 

In such the ergodic distribution function F{-) is the Gaussian law 

with zero mean and variance 1/2. The asymptotic variance S(6') assumes 
the following form 

^C) - /. ^)) X- ^)) ^ ^"^^ 

where erf (a;) = ^ e~*^dt is the classical error function. 

In Figure |l| it is shown that for this model there exists the phenomenon 
of stochastic resonance. For a fixed level of noise e the Fisher information 
increases as the signal 6 is closer to the threshold r. For a fixed value of the 
signal 6, the Fisher information, as a function of e, has a single maximum, 
that is the optimal level of noise. For example, if ^ = then the optimal 
level is e* = 0.1811 and for 6 = 0.5 it is e* = 0.7244. 
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4 Measuring the observed energy 



Suppose that it is possibile to observe not only the time when the per- 
turbed process is over the threshold but also its trajectory above r, say 
Mt = YtX{Yt>T}, t < T. We now show how it is possibile to estimate the 
unknown signal 6 from the equivalent of the energy of the signal for Mt: 
literally from the quantity 

1 r'^ 

We use the following general result from [^] on the estimation of functionals 
of the invariant distribution functions for ergodic diffusion processes. Let 
R{-) and N{-) be such that E + 1^(01) < oo. Then 



^ j\{Xt)dXt + ^ j\{Xt)dt 



is a \/T -consistent estimator for v = E {R{^)S{^) + N{^)) where ^ is dis- 
tributed according to F{-). In our case R{-) = and N{x) = (£x-\-9Yx[x> ^-"j • 
The estimator z/j- can be rewritten as 

and it converges to the quantity 



V 



that is a continuous and increasing function of < < r. Its inverse 
9{i') = v'^iv) allows us to have again 6*^ = 6'(z/t) = z/~^(z/t). By applying 
the (5-method once again, we can obtain the asymptotic variance of 9t from 
the asymptotic variance of ut- 

Vt{9M - 9{v)) = "^^J^^^ + ot{Wt - H) 

where 
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The asymptotic variance of ut is given by (see 



v{e) = v{u{e)) = 4E 

where 



M{y) = E { {F{y) - X{i<y}) K + 0)\^>r^}} 

and its inverse is also the minimal asymptotic variance in the problem of 
estimation of functionals for ergodic diffusion. Thus, the asymptotic variance 
of 6t is given by 

£(„.4e{^}/.W. 

Remark: By the asymptotic normality of vt follows that 9t is also the 
value that maximizes the approximate likelihood function. In fact, as in the 
previous example, if we approximate the density function of vt with 

it is clear that 9t is its maximum. 



4.1 The effect of stochastic resonance 

As before, we put in evidence the phenomenon of stochastic resonance by 
using the Ornstein-Uhlenbeck process as noise. The quantities involved (z^(6') 
and v'iO)) transform into the following 

2^2 + 2£^e-(^)'- + 2 erf 





(from which it appears that v{9) is an increasing function of 9) and 
y'{e) = e + ^——^ ^erf 



e a/tt \ e 

In Figure |I] it is plotted the Fisher information of the model as a function 
of 9 and e. Also in this case there is evidence of stochastic resonance. For 
a fixed value of 6 is then possibile to find the optimal noise level e. For 
example, taking = then we have stochastic resonance at e* = 0.7234 and 
for e = 0.5, e* = 0.3636. 
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5 Hypotheses testing problem 

We now study a problem of testing two simple hypotheses for the model 
discussed in the previous section. As in [Q, we apply the maximum a pos- 
teriori probability (MAP) criterion. We will see that the decision rules for 
our model are similar to the one proposed by Chapeau-Blondeau in the i.i.d. 
setting. 

Given the observation Ft we want to verify the null hypothesis that the 
unknown constant signal is 6*0 against the simple alternative 9i, with 9o < 
Oi < r: 

Ho : = ^^0 
Hi : ^ = ^1 

Suppose that, before observing Ft, we have a prior information on the pa- 
rameter, that is Po = P{9 = 9o) and Pi = P{9 = 9i). The MAP criterion 
uses the following likelihood ratio 

P{9 = 9i\Tt) _ v{9i;Tt)Pi 
P{9 = 9o\Tt) ^(^o;rT)Po 

and the decision rule is to accept Hq whenever A > 1 (decision Di) or refuse 
it otherwise (decision Dq). The overall probability of error is 

Pe„ = P(Dl|Ho)Po + P(/^o|Hi)Pi . 

Let now be 

cr^ = ^^^, /.. = 1-f(^), ^ = 0,l. (4) 
Then, the likelihood A appears as 

2 f-r ,. ^2 



aoPi r ifiTT-fiif (rr-/io) 



'=^r'\-2[-^! ^)r''^'^ 

To write explicitly the decision rule and then study the effect of stochastic 
resonance we have to distinguish three cases: ctq > (Xi, ctq < and ao = cxi. 

1. Let it be > cxi, then put 

yUi ctq - 1^0 erf - o-Q o-i 

c^2 = V ^0 - 7' = -2 

^2 



A = (/io - fiif - 2 0-2 log 





7' 




7" 
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Ail o-Q - A^o c^? + c^o o"! 



Then, if A < accept Hq and Perr = Pi- If A > 0, then if 7' < < 
7" reject Hq otherwise accept it. In both cases 



2 I V (T0V2 J V croV2 



2. Let it be ctq < (Xi, then put 



(T2 = V - 7' - 



2 



A = (/io - /ii) - 2 log 7 = 2 

Then, if A < reject Hq and Perr = Po- If A > 0, then if 7' < Ft < 7" 
accept Hq otherwise reject it. In both cases 



2 i V cTi\/2 / V (T1V2 

+ U2-erf (ll^)+ert(:^ 
2 1 V CJ0V2 J V aoV2 

3. Let it be ctq = Ui, then put 

/.?-/ig + 2aoMog fe) 

7 = ^ — 

2(/ii - /io) 

Then, if > 7 reject Hq otherwise accept it. In both cases 
Pe.. = -(l + erffl^l P,-erf^^-^° 



5.1 Example 



(5) 



• 



2 i V c^iV2 / V c^oV2 



As before, we apply this method to the Ornstein-Uhlenbeck model. In this 
case the variance af = <jf{0, e, r, T), for a fixed threshold r and noise level e, 
is a non decreasing function of 6 being T only a scale factor (Figure ^ gives 
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a numerical representation of this statement). Thus, the Perr is, in general, 
given by formula @. What is amazing is the behavior of Perr- In Figure ^ 
it is reported the graph of Perr as a function of e and 6i given r = 1 and 
60 = 0. For 61 around 1/2 the Perr shows the effect of stochastic resonance. 
So it appears that in some cases the noise level e can reduce sensibly the 
overall probability of making the wrong decision. This kind of behavior is 
non outlined in the work of 0]. 

Remark: Following the same scheme, similar results can be obtained 
for the model ii) when we observe the energy vt- In this case it is sufficient 
to replace in the values of af and fii with the quantities 

a^ = ^, fii = iy{e.), t = 0,l 
and Ft with vt in the decision rule. 



Final remarks 

The use of ergodic diffusions as noise in the problem of stochastic resonance 
seems quite powerful. Characterizations of classes of ergodic process that 
enhance the stochastic resonance can be done (see e.g. 0) but not in a 
simple way as in the i.i.d. case as calculations are always cumbersome. The 
problem of a parametric non constant signal can also be treated while the full 
nonparametric non constant signal requires more attention and will be object 



for further investigations. For i.i.d. observations, |TJ] and |T5[ considered 
the problem of non parametric estimation for regression models of the form 
F(tj) = s{ti) + o"(tj), 2 = 1, . . . ,n. Their approach can be applied in this 
context. 

Other criterion of optimality than the Fisher information quantity can 
be used as it is usually done in information theory (e.g. Shannon mutual 
information or KuUback divergence). 

The analysis of the overall probability of error seems to put in evidence 
something new with respect to the current literature (see e.g. [Q). It is 
worth noting that in a recent paper models driven by ergodic diffusions 
have also been used but the effect of stochastic resonance is not used to 
estimate parameters. 
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Figure 1: The Fisher information T,{9) when observing Tt (up) and 11(6') ^ 
when the observation is ut (down) exhibit stochastic resonance. The thresh- 
old is fixed at T = 1. 
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Figure 2: The variance V{{t — 9)/e) with t — 1. 
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Figure 3: The significant part of tlie plot of Perr as a function of e for different 
values of 9i given r — 1 and 9o — 0. Prom left-top to right-bottom: 6i = 0.1, 
0.25, 0.5, 0.75, 0.9, 0.95. The bottom plot is to show the effect of stochastic 
resonance for 9i — 0.5. 
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